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Abstract 

Following the works of we introduce a diagrammatic for- 



a 

Q ' mulation for a cavity field expansion around the critical temperature. 

This approach allows us to obtain a theory for the overlap's fluctua- 
tions and, in particular, the linear part of the Ghirlanda-Guerra rela- 

^ ■ tionships (GG) (often called Aizenman-Contucci polynomials (AC)) 

OO ' 

in a very simple way. We show moreover how these constraints are 
\& , "superimposed" by the symmetry of the model with respect to the 



restriction required by thermodynamic stability. Within this frame- 



, work it is possible to expand the free energy in terms of these irre- 

ducible overlaps fluctuations and in a form that simply put in evi- 
dence how the complexity of the solution is related to the complexity 



of the entropy. 
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1 Introduction 



The configuration space of the Sherrington-Kirkpatrick model (SK) is built 
by N Ising variables {a{\ which interact respecting the following Hamilto- 
nian H({a}) 



N.N N 



H{{v}) = -A^^ hjWj -h^ai (1) 

V i<j i 

where h is an external scalar field, which, for the rest of the paper, we will 
set to zero, and Jij are i.i.d. Gaussian variables such that P [Jij]: 

™=ri[4^ cx p(-^4)]- ( 2 ) 

i<j V 

Once defined the partition function Z{(3, Jij) as 



Z N ((3,J ij )=Y j e%?^ Jm (3) 
M 

with the inverse temperature f3 = T^ 1 in proper units, the Gibbs measure 

Gjv(<7;/3, Jij) 

and all the standard statistical mechanics package, let us introduce also 
the average over the {Jij} denoting by E(.): 



E [/ {Jij)] = J] ~7f> / dJijf [Jij) exp(-4/2). (4) 

i<j V 

We are interested in the explicit expression for the quenched average of the 
free energy density (we will use the symbol F for the free energy and / for 
its density): 

a(/3) = UmN^ooOtN{P) = -fif (/?) = lim N ^ 00 N~ 1 ~ElnZ N (/?, J^) . (5) 
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Let us introduce some basic notation: For a function /({<7'i}(i=i,..,jv)) J) of 
the degrees of freedom {a} and the noise J we define: 

^I/CW)] = ^'v J({ !-^ff(W) — as tne thermal average, 

tt[f({<J a )}] = WiLffc 1 )] • w 2 [/(a 2 )] • ... • uj n [f(a n )] as the generalized 
thermal average over the replicas of the system [5], 

(/({cr}, J)) = £T2[/{ct}] as the average first on the thermal weight and 
than over the coupling 0, 

9q/3 = AT -1 Yli afaf as the overlap of two replicas, 

9q/37 = ^V _1 ^f^i®] as the overlap over three replicas and so on. 

2 Cavity field: toward a diagrammatic for- 
mulation 

The main idea of the cavity field method is to look for an explicit expression 
of a{(3) — —(3f(/3) upon increasing the size of the system from N particles 
(the cavity) to N+ 1 (see 00 UHIE!) so that, in the limit of N that goes 
to infinity 

[-0F N+1 (P)] - [-0F N (P)] = -Pf(P) +0(i) 

because the existence of the thermodynamic limit |14| implies only van- 
ishing correction of the free energy density. 

So, following 11 in a variant nowadays called stochastic stability |12| . 
let us introduce an extended partition function |l(Jj able to manage the 
interaction with the added spin through a control parameter i £ [0, f3 2 ] such 
that for t=0 we have the classical partition function of -/V spins while for 
t = P we get the expression of the partition function for the larger system 
with a little temperature shift which vanishes in the thermodynamic limit. 
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Z N , t = ]T e~ f3H "^ + VlT.?J^ (6) 

when t — [3 2 , redefining Jj — > J^jv+i and making the transformation <7j — > 
Cif at+1 Vi we obtain the partition function for a system of TV + 1 spin at 
a scaled temperature [3* such that 

p* = 0y/(N + 1)/N -» /3 for TV -» oo. (7) 

Now we will try to formalize some concepts which will be useful developing 
this version of cavity method: 

Proposition 1 The averages (.) are invariant under replica symmetry. In 
fact if we consider a generic element g of the group G of the permutation 
of s replicas, defining a generic replica (a) and its transformed (a'), the 
action of g on (a) is such that: 

G3g:g*(a) = (a') (F(q ab )} = (F(q AB ,)} 
Proposition 2 The averages (.) are invariant under gauge symmetry: 

(8) 



qab -» tatbqab (9) 

being e a = ±1 

This symmetry is a consequence of the parity of the state fi and of di- 
chotomy of Ising variables. 

Definition 1 we define as filled a polynomial of the overlaps in which every 
replica appears an even number of times. 

Definition 2 we define as fillable a polynomial in which the above property 
is obtainable by multiplying the polynomial itself for just one overlap of two 
replicas that is exactly the needed term to fill the expression. 
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Definition 3 we define as un-fillable a polynomial which is neither filled 
nor fillable. 

Example: the following expressions are filled: qf 2 , 912(223931 ■ 
Example: the following expression are fillable: q\2, 912923- 
Example: the following expressions are un-fillable: 91234, 912923945- 

Definition 4 We define the cavity function ^f(t) as: 

*(t) = £[lnw(e^£. J ' a ')] = E[\n^] (10) 
and let F be a generic function of the {a} such that, 

Definition 5 we define the generalized Boltzmann state obtained using 
the partition function 11 (H/ as: 

^{F) = K (11) 

Theorem 1 In the N — > 00 limit the averages (.) of the filled polynomials 
are t-independent in [3 average. 

Proof 

Without loss of generality we will prove the theorem in the simplest 
case (for 9i 2 )- Let us write the cavity function as 

= E[lnZ Nt \ - E[lnZ N ] (12) 

and derive it respect to /3: 

dW) I3N 2 2 

-Tg- = — (W12) - Wia/t)- ( 13 ) 
We can introduce an auxiliary function Tjv (£,/?): 

r N (t,(3) = ^d (3 4* N (t,p)] (w) 
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and integrate it in the interval [/3i,/?2]: 

f 2 T N (t,(3)df3 2 = h^ N (t,uj(p 2 )) -*jv(t,wC9i))]. (15) 

hi N 

In the thermodynamic limit ^(t) remains limited and the second member 
goes to zero; so, V [f3 2 ,(3 2 ] we can always extract a subsequence such that 
the Tjv(£) converge to zero in Lebesgue measure. 

The next theorem is crucial for this paper, so, for the sake of simplic- 
ity we divided it in two part: the first one will be the following lemma 
and it will make us able to proof the theorem itself which will be showed 
immediately after. 

Lemma 1 Let lu(.) and uj t (.) be the states defined respectively by the 
canonical partition function and by the extended one; if we consider the 
ensemble of index {i\, ..,i r } with r e [1,-/V], ^en for t — [3 2 the following 
relation holds: 

VN,t=0 2 (<Tii> -,<7i r ) = UN+i(o-n, ...,a ir ,a^ +1 ) + O(-) (16) 

where r is an exponent, not a replica index, so if r is even o- T N+1 = 1, while 
if is odd cr r N+1 = a N+1 . 

Proof 

Let us write the uj t for t = f3 2 defining for the sake of simplicity a = 

uJ N ,t=F(o-) =E[V^ e ^ E ^ Ji ^ + ^ E ^ CT V]. (17) 
M Zn ^ 2 

Introducing a sum over ctjv+i at the numerator and at the denominator, 
(which is the same as multiply and divide for 2^ because there is no depen- 
dence to (Tjv+i) and making the transformation Uj — > (TjC7jv+i, the variable 
ctn+i appears at the numerator and it is possible to build the status at 
N + 1 particles. Expanding [3* for large N we have that: 
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UN,t=02(<r) = U N +i((T(Tn +1 ) + ( 18 ) 

Using this lemma we are able to proof the following: 

Theorem 2 Let Q ao be a fillable polynomial of the overlaps, ( this means 
that (q a bQab) is filled). We have: 

Jim lim (Q a b)t = (qabQab) (19) 

Proof 

We write the average splitting the dependence from the non filled repli- 
cas a,b to the others: 

Qab = ^2^Qij(cT). (20) 

ij 

We have indicated with Qij(cr) the product of the non filled replicas. Fac- 
torizing the state fl we obtain: 

(Q ab ) t = lEEntWojQyW)] - (21) 

ij 

= ^E[£^Vt(4A(^)]- (22) 

ij 

Now we write the last expression for t = j3 2 \ using the lemma, the states 
acting on the replicas a and b are 

w t =r(o?)=u;{o?o a N+1 ) + 0{±) (23) 

while the remaining product state fi t continue to work on a even number 
of replicas and is not modified 

n t=0 2(Q ij ) = Q(Q ij ). (24) 

Putting all the replicas in a unique product state we have: 
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wK^+iM^+iMQtf) = ^>y N+ X^N + xQii)- (25) 

Using replica symmetry we can write the index N + 1 as a " fc" dumb one; 
pass on, we can sum on all "k" from 1 to N and divide for N because the 
terms with k equal to one of the index i,j are of order O(^) and became 
irrelevant in the N — > oo limit. So: 

(Qab)tr = N- 3 nY, ^t^iQij^)] + O(^) (26) 

ijk 

and in the thermodynamic limit we have the proof. 

Let us remember (this will be useful soon) an important theorem, due 
to Guerra, stating that the streaming equations for the cavity fields are 



Theorem 3 Let F s £E {A s }, where {A s } is the algebra built by the overlaps 
of s replicas; the following streaming equation for F holds: 

s s(s + 1) 
dt(F s ) t =<F s {^2qa,b-sJ2 1 H ^ Qs+l,s+2 ))f (27) 

a,b a=l 

By now we define abstract graphs in this way: We introduce numbered 
vertexes to label replicas of the system and lines between them to label 
their overlaps; for example (912)4 will be associated to the graph 1< — *2, 
(q\ 2 )t to lC^2 and so on. It is obvious that there is a one to one connection 
between polynomials and graphs. 

3 Free Energy and Cavity Function 

Now we want to show how it is possible to expand the SK free energy via 
these graphs. Look carefully at the energy of the system, using thermody- 
namic relations we have: 

EHH N )} = -Nd p a N (l3) = -n d f N { f£ \ - =^(1 - <<&»• (28) 
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So in our vocabulary: 



Proposition 3 The internal energy of SK model is: 

E[u N ((3)} = ±E[u,j(H N (a,J))] = - (O)). 

Theorem 4 Assuming that ZiTOjv^ 00 \E'jv(/3) = V&(/3) exists uniformly in 
every compact < /3 < (3* than the following relation holds: 

"(P) + f a'p = ln2 + 9(0) (29) 

where tyjsr(/3) is the cavity function previously defined. 

This theorem give us a connection between the cavity function in the limit 
t — > /3 2 , the free energy and the internal energy of the system. 

Proof: 

Consider the partition function of a system of (N + 1) spins and point 
out with (3 the effective temperature and with [3* the scaled one: 

{cti,..,(Tjv + i} { ct n} 

(30) 

Multiplying and dividing for Zpf(f3*), taking the logarithm, subtracting 
from every members the quantity lnZpf+i(P*) and expanding ItiZn+i((3) 
around (3 = [3* we have: 

lnZ N+l {[3) - lnZ N+1 ([3*) = {(3- (3*)d .lnZ N+1 (f3*) + 0{d(3 2 ) (31) 

being: 

/ AT l 1 R* 

((3 ~ 0*) = n\j 1) = y + OiN- 1 ). (32) 

Substituting [3 with (3* inside the state u> apart corrections 0(N~ 1 ) we 
have: 

lnZ N+1 ([3*) + (f3- /3*)d *lnZ N+ i(f3*) = (33) 
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ln2 + lnZ N (/3*) + lnuj { f\e^TT Y: ^ haz ) + 0{N- 1 ). 

Taking the average E, using the variable a and renaming (3* — > /3 in the 
thermodynamic limit we get: 

<*(P) + ^d p a(P) = ln2 + (34) 

and this is the thesis of the theorem (see also ^1 E| f° r further details 
concerning the theorem above). So we can study cavity function to un- 
derstand properties of the free energy. To do this, derive now the cavity 
function using the standard integration over Gaussian noise: 

cW) == ±E[1 - -^XXVO] = \<> ~ (35) 

i 

Note, being Zjy.o = Zn, that the cavity function itself is obtainable as 
an integral over t of the simplest two-replicas overlap weighted with the 
generalized Boltzmann state u>t- 

1 '* 



* N (t t w)-V N (0,w) = 9 N (t,w) = - dt'(l- (q 12 ) t >). (36) 

1 Jo 

Let us show how to expand qi% = « — •: As the parameter of expansion 



we define the number of lines of the filled graphs; surely for the non-filled 
ones their parameter will be the corresponding one of the same order filled 
graph. Before starting the expansion we present just some simple example: 

o 

es.l)cO) this graph is of the fourth order, filled and means the quantity 

es.2)(^^) this graph is of the fifth order, tillable and means the quantity 
(?i2<?23<Zi3945) (moreover its filled corresponding is (^-^ < ^I))- 
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Remembering the streaming equation and the pull of rules developed 
before we can write: 



dt{~) t = (0-4— + 3^> t (37) 

At this first step we find a filled graph, q 2 2 ; For it the perturbative expan- 
sion is ended here. Now we have to express also the other graphs (the non 
filled ones) in terms of the filled: 



(38) 



dt(~) t = (2« + 4l— -l6—~+10.— ) t . (39) 
Another filled one has been obtained (the first of the r.h.s. of the eq. (|38|l % ). 

However we have to go on for the others. 

= (0- + 6^ + go _ 3-o- - 3 cx - 3 o— + 6 Qr>, 
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(40) 

and so on. We stop here our expansion for now, showing just the result for 
higher orders. Neglecting terms order /3 10 we have: 

o 

(_>) t = (Ot - 2 At 2 - -COt 3 + Ot 3 + eQ 5 - (4i) 

3 

+10 0<4_H2<>^- 8 0< 4) . 

3 

We can now write (formally at any level of knowledge) the ^f(j3) and, being 
known also the expression for the internal energy, we are able to write the 
expression for the free energy. 
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Proposition 4 the free energy expansion via irreducible overlaps fluctua- 
tions is 

a{(i) = (ln2 + ^[1 + (1 - /3 2 )0] + tA+^CO- (42) 
4 3 6 

8 4 M 5 3 ; VM ; 

As we can immediately see this solution is built by more and more 
overlaps correlation functions (complete graphs) which a replica-symmetric 
theory cannot generate; moreover it is also easy to see that in the high 
temperature phase it reproduces the right expression and that the birth of 
all these correlations functions is just due to the entropy, being the energy 
density: 

-dpa{0) = - <0» (43) 

while the entropy is: 

m - (taJ -£a- s O)-£O4A40O-£8) + ... m 

4 Overlap Constraint Generator 

Now we want to use a pure thermodynamical approach to obtain the 
Aizenman-Contucci polynomials: we simply impose on the theory that 
the total derivative of the free energy with respect to (3 2 has to be (in mod- 
ulus) the internal energy of the system: (doing this we use the redundant 
formalism of a(/3, (-)a 2 ) instead of a((3) to put in evidence how to perform 
the right derivative.) 

a{fi, (V) = P»2 + ¥(t, (.)t) - j(l - (<&»W- (45) 
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Its total derivative respect to (3 is: 

^a(/3, Qp) = (V) + ^ ^ ^ , (46) 

where the expression > means i/ie sum ewer t/ie ^i^erf graphs contained 
in the a and this derivative is equal (in modulus) to the internal energy: 

^a(/3,(V) = ^ = |(l -<«?2». (47) 
Start to calculate the total derivative: the partial one is 

d^a(fi, 0/30 = (•)) - J(l - («?2»W (48) 



where 



(.))*=/»» = Hm ^(1 - (<7i 2 )t) - ~(1 - (<&». (49) 



2 a(P,{.)fp)=Bpa(p,{.)fp) (50) 



So the partial and the total derivative are the same 

_d 

dp 

therefore the following quantity has to be identically zero: 

d(.) (5) 

Giving an explicit expression we have: 

Proposition 5 the following expansion is the "thermodynamic" generator 
of the Aizenman- Contucci restrictions for the overlaps fluctuations: 

o 

, da 9O da aA da dOO da dO s / 

+ ...) = 0. (52) 



dO df}2 d A 9/32 dCQ d ? 2 O^ 2 

dO 

We try now to extrapolate some information from the above statement, 
starting to note that the apparently redundant word thermodynamics has 
been used to put in evidence the difference with the next overlap constraint 
generator which will be called symmetric because it will be derived just 
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using the properties of the symmetry of the model. 

Starting to study every single monomial we find a common structure to all 
members of the polynomial. For the first one: 

, da <9^3, 3 2 , 9n 1 „ , , . , . 

^-(l-/3 2 )— dpEn s (q 2 12 ) = (53) 



- NmKi&XE&e - »Ed + '^^i 2 s +1 . s+2 ))}. (54) 

For the second one: 

da /? 6 1 

-5 /3 Efi s (qi 2 qi3g23) = (55) 



dp 1 3 2/3 

= W)[<( gi 2g 18 <&3)E</J " s E^+i + ^j^-^+i,^))]- (56) 

We are now able to write the 152fl in this other way: 



We started taking as the parameter of the expansion the number of links 
inside a graph but, because there is a complete equivalence with the order 
of /3 2 , now we do the opposite: we think as the parameter /3 2 and being the 
equation l|52|) a polynomial in /3 2 equal to zero we have the right to put to 
zero every monomial inside. The first order give us: 



(^(1 - /3 2 A£^ - + £(£±I2^ +m+2 ]) = (58) 

a,P a 
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If we put out from the averages the temperature function in order to neglect 
it when it's a well defined quantity we obtain: 



-4OO + 3O) = (59) 



This is the first Aizenman-Contucci relation or the first linear part of the 
Ghirlanda-Guerra identities. For the second order it's the same: 



/^_ 3 0<J +2 0< 



= (60) 



Now we can start to look at the third order: we want to prove that the 
restrictions imposed by thermodynamic arguments are "sweet' with respect 
to the ones showed using symmetry properties of SK model Look at the 
expansion in 1 of 1)57(1 . thermodynamic requires that: 



([loo. 10 - -.5:^ + ^4 2 +M+2 ]> = 0. 

a,/3 a 

(61) 

Anyway, reading again the pull of rules developed before, we could state 
that: 

Proposition 6 the following expansion is the "symmetric" generator of 
the Aizenman-Contucci restrictions for the overlaps fluctuations: 



lim lim d t [f tiled graph] =0 (62) 

N— too 

This property has been demonstrated implicitly because in the expansion 
previously showed we did not develop the graphs q\ 2 ,912923931 being them 
independent from the t parameter. Now we can look at this property also 
like a generator of constraints for the overlaps. Here we have some exam- 
ples: Start with the first filled graphs and find again the linear Ghirlanda- 
Guerra relations: 
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o 

Urn lim dt [q\ 2 ] = - 4 CO + 3O) = (63) 



lim lim 9 t [gi2<?2393i] = = (64) 

AT— »oo t^fi 2 

We can show how the derivative and the t-limit act together (in the ther- 
modynamic limit) on a filled graph: 



lim lim dt([filled graph]) = (65) 

N— >oo i— >/3 2 

= ([filled graph}[^2q 2 aJ3 - s^g£ )8+1 + gJ +1;S+2 ]>. 

a,0 a 

It's interesting that such constrictions, that are properties of SK model, 
are not strictly imposed by thermodynamic and are stronger that that ones: 
If we came back to look again at the fourth order (/3 8 ) in our expansion we 
have that thermodynamic requires for the sum of the three filled graphs in 
the expression H61(l (multiplied by the second parenthesis of the expression) 
to be zero but we have already show that also every single term in the 
above expression have to be zero. So the thermodynamic conditions are 
(respected and) weaker than that required by the symmetry of the model 
and this has the consequence that the system is not allowed to exploit the 
whole space but only the part of it where these restrictions hold. Moreover 
we found in this way a manner to build explicitly a kind of constriction 
tree for the overlap fluctuations because to obtain the restrictions at the 
fourth order we had to derive the unique graph of the second order and, 
after the limit of t that goes to /3 2 , we had to put that expression to zero 
obtaining linear GG identities. So to obtain the same constriction at the 
order six we can derive three of the four graphs of the fourth order (one is 
linearly dependent by the relation itself) and so on. 



16 



5 Conclusion and Outlook 



In this paper we have used the method of the cavity fields via an interpo- 
lating parameter: we found this useful to derive an explicit expression for 
the free energy immediately below the critical temperature in terms of ir- 
reducible correlations functions of overlaps fluctuations (filled graphs). At 
the same time we obtained a way to generate systematically the constric- 
tions to their free fluctuations (linear GG, and we found that, in the 
broken replica phase, the SK behavior is restricted mainly by its internal 
symmetries more than by thermodynamic stability. Future development 
should be finalized to apply this approach also to other mean field models 
with Gaussian quenched disorder and at the same time it should be useful 
to understand deeply which is the behavior of the tree of the constrictions 
at every non trivial order. 
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1 Introduction 



The configuration space of the Sherrington-Kirkpatrick model (SK) is built 
by N Ising variables {a{\ which interact respecting the following Hamilto- 
nian H({a}) 



N.N N 



H{{v}) = -A^^ hjWj -h^ai (1) 

V i<j i 

where h is an external scalar field, which, for the rest of the paper, we will 
set to zero, and Jij are i.i.d. Gaussian variables such that P [Jij]: 

™=ri[4^ cx p(-^4)]- ( 2 ) 

i<j V 

Once defined the partition function Z{(3, Jij) as 



Z N ((3,J ij )=Y j e%?^ Jm (3) 
M 

with the inverse temperature f3 = T^ 1 in proper units, the Gibbs measure 

Gjv(<7;/3, Jij) 

and all the standard statistical mechanics package, let us introduce also 
the average over the {Jij} denoting by E(.): 



E [/ {Jij)] = J] ~7f> / dJijf [Jij) exp(-4/2). (4) 

i<j V 

We are interested in the explicit expression for the quenched average of the 
free energy density (we will use the symbol F for the free energy and / for 
its density): 

a(/3) = UmN^ooOtN{P) = -fif (/?) = lim N ^ 00 N~ 1 ~ElnZ N (/?, J^) . (5) 
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Let us introduce some basic notation: For a function /({<7'i}(i=i,..,jv)) J) of 
the degrees of freedom {a} and the noise J we define: 

^I/CW)] = ^'v J({ !-^ff(W) — as tne thermal average, 

tt[f({<J a )}} = WiL/V)] * ^ 2 [/(a 2 )] * ... * w„[/(<7 n )] as the generalized 
thermal average over the replicas of the system [5], 

(/({cr}, J)) = £T2[/{ct}] as the average first on the thermal weight and 
than over the coupling 0, 

9q/3 = AT -1 Yli afaf as the overlap of two replicas, 

9q/37 = ^V _1 ^f^i®] as the overlap over three replicas and so on. 

2 Cavity field: toward a diagrammatic for- 
mulation 

The main idea of the cavity field method is to look for an explicit expression 
of a{j3) — —f3f(/3) upon increasing the size of the system from N particles 
(the cavity) to N+ 1 (see 00 UHIE!) so that, in the limit of N that goes 
to infinity 

[-0F N+1 (P)] - [-0F N (P)] = -0f(fi)+O(-fr) 

because the existence of the thermodynamic limit |14| implies only van- 
ishing correction of the free energy density. 

So, following 11 in a variant nowadays called stochastic stability |12| . 
let us introduce an extended partition function |l(Jj able to manage the 
interaction with the added spin through a control parameter i £ [0, f3 2 ] such 
that for t=0 we have the classical partition function of -/V spins while for 
t = P we get the expression of the partition function for the larger system 
with a little temperature shift which vanishes in the thermodynamic limit. 



3 



Z N , t = ]T e~ f3H "^ + VlT.?J^ (6) 

when t — [3 2 , redefining Jj — > J^jv+i and making the transformation <7j — > 
Cif at+1 Vi we obtain the partition function for a system of TV + 1 spin at 
a scaled temperature [3* such that 

p* = 0y/(N + 1)/N -» /3 for TV -» oo. (7) 

Now we will try to formalize some concepts which will be useful developing 
this version of cavity method: 

Proposition 1 The averages (.) are invariant under replica symmetry. In 
fact if we consider a generic element g of the group G of the permutation 
of s replicas, defining a generic replica (a) and its transformed (a'), the 
action of g on (a) is such that: 

G3g:g*(a) = (a') (F(q ab )} = (F(q AB ,)} 
Proposition 2 The averages (.) are invariant under gauge symmetry: 

(8) 



qab -» tatbqab (9) 

being e a = ±1 

This symmetry is a consequence of the parity of the state fi and of di- 
chotomy of Ising variables. 

Definition 1 we define as filled a polynomial of the overlaps in which every 
replica appears an even number of times. 

Definition 2 we define as fillable a polynomial in which the above property 
is obtainable by multiplying the polynomial itself for just one overlap of two 
replicas that is exactly the needed term to fill the expression. 
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Definition 3 we define as un-fillable a polynomial which is neither filled 
nor fillable. 

Example: the following expressions are filled: qf 2 , 912(223931 ■ 
Example: the following expression are fillable: q\2, 912923- 
Example: the following expressions are un-fillable: 91234, 912923945- 

Definition 4 We define the cavity function ^f(t) as: 

*(t) = £[lnw(e^£. J ' a ')] = E[\n^] (10) 
and let F be a generic function of the {a} such that, 

Definition 5 we define the generalized Boltzmann state obtained using 
the partition function 11 (H/ as: 

^{F) = K (11) 

Theorem 1 In the N — > 00 limit the averages (.) of the filled polynomials 
are t-independent in [3 average. 

Proof 

Without loss of generality we will prove the theorem in the simplest 
case (for 9i 2 )- Let us write the cavity function as 

= E[lnZ Nt \ - E[lnZ N ] (12) 

and derive it respect to /3: 

dW) I3N 2 2 

-Tg- = — (W12) - Wia/t)- ( 13 ) 
We can introduce an auxiliary function Tjv (£,/?): 

r N (t,(3) = ^d (3 4* N (t,p)] (w) 
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and integrate it in the interval [/3i,/?2]: 

f 2 T N (t,(3)df3 2 = h^ N (t,uj(p 2 )) -*jv(t,wC9i))]. (15) 

hi N 

In the thermodynamic limit ^(t) remains limited and the second member 
goes to zero; so, V [f3 2 ,(3 2 ] we can always extract a subsequence such that 
the Tjv(£) converge to zero in Lebesgue measure. 

The next theorem is crucial for this paper, so, for the sake of simplic- 
ity we divided it in two part: the first one will be the following lemma 
and it will make us able to proof the theorem itself which will be showed 
immediately after. 

Lemma 1 Let lu(.) and uj t (.) be the states defined respectively by the 
canonical partition function and by the extended one; if we consider the 
ensemble of index {i\, ..,i r } with r e [1,-/V], ^en for t — [3 2 the following 
relation holds: 

VN,t=0 2 (<Tii> -,<7i r ) = UN+i(o-n, ...,a ir ,a^ +1 ) + O(-) (16) 

where r is an exponent, not a replica index, so if r is even o- T N+1 = 1, while 
if is odd cr r N+1 = a N+1 . 

Proof 

Let us write the uj t for t = f3 2 defining for the sake of simplicity a = 

uJ N ,t=F(o-) =E[V^ e ^ E ^ Ji ^ + ^ E ^ CT V]. (17) 
M Zn ^ 2 

Introducing a sum over ctjv+i at the numerator and at the denominator, 
(which is the same as multiply and divide for 2^ because there is no depen- 
dence to (Tjv+i) and making the transformation Uj — > (TjC7jv+i, the variable 
ctn+i appears at the numerator and it is possible to build the status at 
N + 1 particles. Expanding [3* for large N we have that: 
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UN,t=02(<r) = U N +i((T(Tn +1 ) + ( 18 ) 

Using this lemma we are able to proof the following: 

Theorem 2 Let Q ao be a fillable polynomial of the overlaps, ( this means 
that (q a bQab) is filled). We have: 

Jim lim (Q a b)t = (qabQab) (19) 

Proof 

We write the average splitting the dependence from the non filled repli- 
cas a,b to the others: 

Qab = ^2^Qij(cT). (20) 

ij 

We have indicated with Qij(cr) the product of the non filled replicas. Fac- 
torizing the state fl we obtain: 

(Q ab ) t = lEEntWojQyW)] - (21) 

ij 

= ^E[£^Vt(4A(^)]- (22) 

ij 

Now we write the last expression for t = j3 2 \ using the lemma, the states 
acting on the replicas a and b are 

w t =r(o?)=u;{o?o a N+1 ) + 0{±) (23) 

while the remaining product state fi t continue to work on a even number 
of replicas and is not modified 

n t=0 2(Q ij ) = Q(Q ij ). (24) 

Putting all the replicas in a unique product state we have: 
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wK^+iM^+iMQtf) = ^>y N+ X^N + xQii)- (25) 

Using replica symmetry we can write the index N + 1 as a " fc" dumb one; 
pass on, we can sum on all "k" from 1 to N and divide for N because the 
terms with k equal to one of the index i,j are of order O(^) and became 
irrelevant in the N — > oo limit. So: 

(Qab)tr = N- 3 nY, ^t^iQij^)] + O(^) (26) 

ijk 

and in the thermodynamic limit we have the proof. 

Let us remember (this will be useful soon) an important theorem, due 
to Guerra, stating that the streaming equations for the cavity fields are 



Theorem 3 Let F s £E {A s }, where {A s } is the algebra built by the overlaps 
of s replicas; the following streaming equation for F holds: 

s s(s + 1) 
dt(F s ) t =<F s {^2qa,b-sJ2 1 H ^ Qs+l,s+2 ))f (27) 

a,b a=l 

By now we define abstract graphs in this way: We introduce numbered 
vertexes to label replicas of the system and lines between them to label 
their overlaps; for example (912)4 will be associated to the graph 1< — *2, 
(q\ 2 )t to lC^2 and so on. It is obvious that there is a one to one connection 
between polynomials and graphs. 

3 Free Energy and Cavity Function 

Now we want to show how it is possible to expand the SK free energy via 
these graphs. Look carefully at the energy of the system, using thermody- 
namic relations we have: 

EHH N )} = -Nd p a N (l3) = -n d f N { f£ \ - =^(1 - <<&»• (28) 
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So in our vocabulary: 



Proposition 3 The internal energy of SK model is: 

E[u N ((3)} = ±E[u,j(H N (a,J))] = - (O)). 

Theorem 4 Assuming that ZiTOjv^ 00 \E'jv(/3) = V&(/3) exists uniformly in 
every compact < /3 < (3* than the following relation holds: 

"(P) + f a'p = ln2 + 9(0) (29) 

where tyjsr(/3) is the cavity function previously defined. 

This theorem give us a connection between the cavity function in the limit 
t — > /3 2 , the free energy and the internal energy of the system. 

Proof: 

Consider the partition function of a system of (N + 1) spins and point 
out with (3 the effective temperature and with [3* the scaled one: 

{cti,..,(Tjv + i} { ct n} 

(30) 

Multiplying and dividing for Zpf(f3*), taking the logarithm, subtracting 
from every members the quantity lnZpf+i(P*) and expanding ItiZn+i((3) 
around (3 = [3* we have: 

lnZ N+l {[3) - lnZ N+1 ([3*) = {(3- (3*)d .lnZ N+1 (f3*) + 0{d(3 2 ) (31) 

being: 

/ AT l 1 R* 

((3 ~ 0*) = n\j 1) = y + OiN- 1 ). (32) 

Substituting [3 with (3* inside the state u> apart corrections 0(N~ 1 ) we 
have: 

lnZ N+1 ([3*) + (f3- /3*)d *lnZ N+ i(f3*) = (33) 
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ln2 + lnZ N (/3*) + lnuj { f\e^TT Y: ^ haz ) + 0{N- 1 ). 

Taking the average E, using the variable a and renaming (3* — > /3 in the 
thermodynamic limit we get: 

<*(P) + ^d p a(P) = ln2 + (34) 

and this is the thesis of the theorem (see also ^1 E| f° r further details 
concerning the theorem above). So we can study cavity function to un- 
derstand properties of the free energy. To do this, derive now the cavity 
function using the standard integration over Gaussian noise: 

cW) == ±E[1 - -^XXVO] = \<> ~ (35) 

i 

Note, being Zjy.o = Zn, that the cavity function itself is obtainable as 
an integral over t of the simplest two-replicas overlap weighted with the 
generalized Boltzmann state u>t- 

1 '* 



* N (t t w)-V N (0,w) = 9 N (t,w) = - dt'(l- (q 12 ) t >). (36) 

1 Jo 

Let us show how to expand qi% = « — •: As the parameter of expansion 



we define the number of lines of the filled graphs; surely for the non-filled 
ones their parameter will be the corresponding one of the same order filled 
graph. Before starting the expansion we present just some simple example: 

o 

es.l)cO) this graph is of the fourth order, filled and means the quantity 

es.2)(^^) this graph is of the fifth order, tillable and means the quantity 
(?i2<?23<Zi3945) (moreover its filled corresponding is (^-^ < ^I))- 
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Remembering the streaming equation and the pull of rules developed 
before we can write: 



dt{~) t = (0-4— + 3^> t (37) 

At this first step we find a filled graph, q 2 2 ; For it the perturbative expan- 
sion is ended here. Now we have to express also the other graphs (the non 
filled ones) in terms of the filled: 



(38) 



dt(~) t = (2« + 4l— -l6—~+10.— ) t . (39) 
Another filled one has been obtained (the first of the r.h.s. of the eq. (|38|l % ). 

However we have to go on for the others. 

= (0- + 6^ + go _ 3-o- - 3 cx - 3 o— + 6 Qr>, 
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(40) 

and so on. We stop here our expansion for now, showing just the result for 
higher orders. Neglecting terms order /3 10 we have: 

o 

(_>) t = (Ot - 2 At 2 - -COt 3 + Ot 3 + eQ 5 - (4i) 

3 

+10 0<4_H2<>^- 8 0< 4) . 

3 

We can now write (formally at any level of knowledge) the ^f(j3) and, being 
known also the expression for the internal energy, we are able to write the 
expression for the free energy. 
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Proposition 4 the free energy expansion via irreducible overlaps fluctua- 
tions is 

a{(i) = (ln2 + ^[1 + (1 - /3 2 )0] + tA+^CO- (42) 
4 3 6 

8 4 M 5 3 ; VM ; 

As we can immediately see this solution is built by more and more 
overlaps correlation functions (complete graphs) which a replica-symmetric 
theory cannot generate; moreover it is also easy to see that in the high 
temperature phase it reproduces the right expression and that the birth of 
all these correlations functions is just due to the entropy, being the energy 
density: 

-dpa{0) = - <0» (43) 

while the entropy is: 

m - (taJ -£a- s O)-£O4A40O-£8) + ... m 

4 Overlap Constraint Generator 

Now we want to use a pure thermodynamical approach to obtain the 
Aizenman-Contucci polynomials: we simply impose on the theory that 
the total derivative of the free energy with respect to (3 2 has to be (in mod- 
ulus) the internal energy of the system: (doing this we use the redundant 
formalism of a(/3, (-)a 2 ) instead of a((3) to put in evidence how to perform 
the right derivative.) 

a{fi, (V) = P»2 + ¥(t, (.)t) - j(l - (<&»W- (45) 
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Its total derivative respect to (3 is: 

^a(/3, Qp) = (V) + ^ ^ ^ , (46) 

where the expression > means i/ie sum ewer t/ie ^i^erf graphs contained 
in the a and this derivative is equal (in modulus) to the internal energy: 

^a(/3,(V) = ^ = |(l -<«?2». (47) 
Start to calculate the total derivative: the partial one is 

d^a(fi, 0/30 = (•)) - J(l - («?2»W (48) 



where 



(.))*=/»» = Hm ^(1 - (<7i 2 )t) - ~(1 - (<&». (49) 



2 a(P,{.)fp)=Bpa(p,{.)fp) (50) 



So the partial and the total derivative are the same 

_d 

dp 

therefore the following quantity has to be identically zero: 

d(.) (5) 

Giving an explicit expression we have: 

Proposition 5 the following expansion is the "thermodynamic" generator 
of the Aizenman- Contucci restrictions for the overlaps fluctuations: 

o 

, da 9O da aA da dOO da dO s / 

+ ...) = 0. (52) 



dO df}2 d A 9/32 dCQ d ? 2 O^ 2 

dO 

We try now to extrapolate some information from the above statement, 
starting to note that the apparently redundant word thermodynamics has 
been used to put in evidence the difference with the next overlap constraint 
generator which will be called symmetric because it will be derived just 
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using the properties of the symmetry of the model. 

Starting to study every single monomial we find a common structure to all 
members of the polynomial. For the first one: 

, da <9^3, 3 2 , 9n 1 „ , , . , . 

^-(l-/3 2 )— dpEn s (q 2 12 ) = (53) 



- NmKi&XE&e - »Ed + '^^i 2 s +1 . s+2 ))}. (54) 

For the second one: 

da /? 6 1 

-5 /3 Efi s (qi 2 qi3g23) = (55) 



dp 1 3 2/3 

= W)[<( gi 2g 18 <&3)E</J " s E^+i + ^j^-^+i,^))]- (56) 

We are now able to write the 152fl in this other way: 



We started taking as the parameter of the expansion the number of links 
inside a graph but, because there is a complete equivalence with the order 
of /3 2 , now we do the opposite: we think as the parameter /3 2 and being the 
equation l|52|) a polynomial in /3 2 equal to zero we have the right to put to 
zero every monomial inside. The first order give us: 



(^(1 - /3 2 A£^ - + £(£±I2^ +m+2 ]) = (58) 

a,P a 
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If we put out from the averages the temperature function in order to neglect 
it when it's a well defined quantity we obtain: 



-4OO + 3O) = (59) 



This is the first Aizenman-Contucci relation or the first linear part of the 
Ghirlanda-Guerra identities. For the second order it's the same: 



/^_ 3 0<J +2 0< 



= (60) 



Now we can start to look at the third order: we want to prove that the 
restrictions imposed by thermodynamic arguments are "sweet' with respect 
to the ones showed using symmetry properties of SK model Look at the 
expansion in 1 of 1)57(1 . thermodynamic requires that: 



([loo. 10 - -.5:^ + ^4 2 +M+2 ]> = 0. 

a,/3 a 

(61) 

Anyway, reading again the pull of rules developed before, we could state 
that: 

Proposition 6 the following expansion is the "symmetric" generator of 
the Aizenman-Contucci restrictions for the overlaps fluctuations: 



lim lim d t [f tiled graph] =0 (62) 

N— too 

This property has been demonstrated implicitly because in the expansion 
previously showed we did not develop the graphs q\ 2 ,912923931 being them 
independent from the t parameter. Now we can look at this property also 
like a generator of constraints for the overlaps. Here we have some exam- 
ples: Start with the first filled graphs and find again the linear Ghirlanda- 
Guerra relations: 
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o 

Urn lim dt [q\ 2 ] = - 4 CO + 3O) = (63) 



lim lim 9 t [gi2<?2393i] = = (64) 

AT— »oo t^fi 2 

We can show how the derivative and the t-limit act together (in the ther- 
modynamic limit) on a filled graph: 



lim lim dt([filled graph]) = (65) 

N— >oo i— >/3 2 

= ([filled graph}[^2q 2 aJ3 - s^g£ )8+1 + gJ +1;S+2 ]>. 

a,0 a 

It's interesting that such constrictions, that are properties of SK model, 
are not strictly imposed by thermodynamic and are stronger that that ones: 
If we came back to look again at the fourth order (/3 8 ) in our expansion we 
have that thermodynamic requires for the sum of the three filled graphs in 
the expression H61(l (multiplied by the second parenthesis of the expression) 
to be zero but we have already show that also every single term in the 
above expression have to be zero. So the thermodynamic conditions are 
(respected and) weaker than that required by the symmetry of the model 
and this has the consequence that the system is not allowed to exploit the 
whole space but only the part of it where these restrictions hold. Moreover 
we found in this way a manner to build explicitly a kind of constriction 
tree for the overlap fluctuations because to obtain the restrictions at the 
fourth order we had to derive the unique graph of the second order and, 
after the limit of t that goes to /3 2 , we had to put that expression to zero 
obtaining linear GG identities. So to obtain the same constriction at the 
order six we can derive three of the four graphs of the fourth order (one is 
linearly dependent by the relation itself) and so on. 
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5 Conclusion and Outlook 



In this paper we have used the method of the cavity fields via an interpo- 
lating parameter: we found this useful to derive an explicit expression for 
the free energy immediately below the critical temperature in terms of ir- 
reducible correlations functions of overlaps fluctuations (filled graphs). At 
the same time we obtained a way to generate systematically the constric- 
tions to their free fluctuations (linear GG, and we found that, in the 
broken replica phase, the SK behavior is restricted mainly by its internal 
symmetries more than by thermodynamic stability. Future development 
should be finalized to apply this approach also to other mean field models 
with Gaussian quenched disorder and at the same time it should be useful 
to understand deeply which is the behavior of the tree of the constrictions 
at every non trivial order. 
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